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DUAL  COM VEX  COMES  OF  ORDER  RESTRICTIONS  WITH  APPLICATIONS 

1.  INTRODUCTION 

Several  authors  have  made  extensive  use  of  the  concept  of 
convex  cones  and  their  duals.  Among  these  are  Rockafellar  (1970), 
Robertson  and  Wright  (1980)  and  Barlow  and  Brunk  (1972)  .  Here 
we  wish  to  specifically  exhibit  certain  convex  cones  and  their 
duals  and  discuss  the  implications. 

To  be  precise,  we  call  K  c  Rn  a  convex  cone  if 

a)  x,y  e  K  ==*>  x  +  y  e  K,  and 

b)  x  e  K,  a  >.  0  ===*•  a  x  e  K. 

Of  course  if  K  is  a  convex  cone,  so  is  -  K  =  {x:  -  x  e  K) 
which  we  will  call  the  "negative"  of  K. 

Another  important  convex  cone  induced  by  K  is  the  "dual"  of 
K.  For  a  fixed  positive  vector  w,  the  dual  of  K  is  given  by 

w*  ,  n  , 

K~  =  (y:(x,y)  =  Ix.y.w.  <.  0  for  all  x  e  K> . 

~  ^  i  l  i 

(Some  authors  prefer  the  tern  "polar"  to  "dual."  Some  also  define 
the  dual  as  the  negative  of  our  dual.)  Of  course  if  K  is  closed, 

(K~  )~  «  K. 

It  is  evident  that  if  c  Kj,  K|*  3  K^*. 

New  convex  cones  can  be  formed  from  existing  cones  in  several 
ways.  Two  important  methods  are  through  intersections  and  direct 
sums.  (By  the  direct  sum  +  K2  we  mean  {x  +  y:x  e  K^,  y  e  Kj).) 

A  key  relationship  exists  between  intersections,  direct  sum9 
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and  duals  for  closed  convex  cones.  This  relationship,  as  shown  in 
Rockafeller  (1970)  page  146,  is 

w*  w  ★  vr*  w* 

(K,  n  K.  n  ...  n  K  )*  =  K~  +  K~  +...+  K*  .  (1.1) 

12  m  l  2  m 

Some  cones  and  their  duals  are  quite  simple.  For  example,  if 

K  =  (xjXj  >  0} , 

then 

K**  =  (y;yi  <  0,  y2  -  y3  =  ...  =  yn=  0} 

for  all  w.  The  cone 

K  =  (xjx^^  >.  0,  i  -  l,...,n) 
is  interesting  in  that 

w* 

K-  *  -K. 

Another  important  cone,  especially  in  the  area  of  isotone 
regression,  is  the  cone  of  vectors  which  are  nondecreasing,  i.e. 

K_  «  (x:x,  <.  x«  .<  —  <.  x  }  .  (1.2) 

I  ~  i  2  n 

The  dual  cone  here,  as  discussed  in  Barlow  and  Brunk  (1972),  is 

*  i  n 

k!:  =  (y:  E  y.w.  >.  0,  i  =  l,...,n  -  1,  E  y.w.  **  0).  (1.3) 

1  j-1  3  3  j*l  3  3 

We  note  in  passing  that  the  important  concept  of  majorization 
as  discussed  extensively  in  Marshall  and  Olkin  (1979)  is  closely 
connected  with  the  cone  in  (1.3).  If  the  vectors  x  and  y  are  each 
ordered  from  largest  to  smallest  to  form  x  and  y,  x  majorizes  y  iff 
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x  - 


1* 

y  e  K~  . 


(We  let  1  denote  a  vector  containing  all  l's.)  Further  discussion 
of  such  cone  orderings  is  given  in  Marshall,  Walkup,  and  Wets  (1967). 

If  the  cone  specified  in  (1.2)  is  modified  to  require  that  it 
contain  only  nonnegative  vectors,  i.e.. 


K  =  { x : 0  <.  x.  <.  x_  <.  ...  <  x  }  , 

-  12  —  n 

the  dual  is  equivalent  to  that  given  in  (1.3)  with  a  modification  of 
the  last  equality.  In  this  case, 

*  n 

=  (y:  E  y.w.  >_  0,  i  =  l,...,n). 

~  j=l  3  3 


Much  of  our  interest  in  dual  cones  hinges  on  a  duality  result 
discussed  in  Barlow  and  Brunk  (1972).  In  particular  if  g*  solves 
the  problem 

n  2 

Minimize  E  (g.  -  x . )  w.  (1.5) 

x  e  K  i=l  1  1  1 


where  K  is  a  closed  convex  cone ,  then  g  -  g*  solves 


Minimize 

„w* 
x  e  K~ 


n 

E 

i=l 


(gi  ' 


x.)2w.. 


(1.6) 


Robertson  and  Wriqht  (1980)  make  extensive  use  of  this  duality  in 
dealing  with  stochastic  ordering  restrictions  for  multinomial  para¬ 
meters.  This  duality  is  also  important  in  deriving  distributional 
theory,  i.e.,  see  Robertson  and  Wegman  (1978). 
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2.  THE  STARSHAPED  ORDERING 


An  interesting  order  restriction  is  that  a  vector  be  star¬ 
shaped.  Shaked  (1979)  defines  a  vector  x  to  be  lower  (upper) 
starshaped  with  respect  to  the  positive  weights  w  if 

*1  >  x2  >  x3  >  ,  . .  >  xn  >  0  (0  <  Xj  <  x“  i  . . .  <L  Xx) 

where 

i  i 

x.  ■  Z  x.w ./  I  w . .  (2.1) 

1  j-1  3  3  j-1  3 

Shaked  is  concerned  with  finding  maximum  likelihood  estimates 
of  Poisson  and  normal  means  which  must  satisfy  starshaped  restric¬ 
tions. 

Dykstra  and  Robertson  (1981)  use  the  term  "decreasing  (increas 
ing)  on  the  average"  when  the  nonnegativity  restrictions  in  (2.1) 
are  omitted,  and  are  concerned  with  such  restrictions  when  testing 
for  trend. 

Surprisingly  the  dual  cone  of  "increasing  on  the  average" 
vectors  is  closely  associated  with  the  cone  of  "decreasing  on  the 
average"  vectors. 


Theorem  2.1.  If  KT „  =  (x;x,  <.  x„  2: 
-  IA  -  1  2 


<y--y1  >  y2  > 


<.  x  }  ,  then 
n 


0}  . 


Proof.  Note  that  we  can  write 


K  =  (x:x.  -  x...  <.  0,  i  =  l,...,n  -  1) 
IA  -  1  1+1 


n-1 

r* 
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where 


=  (x;  x^  -  xi+1  <.  0} . 


(2.2) 


Now  we  claim  that 


i+1 


H.  =  (y:  0  <.  y.  =  y.  =  ...  =  y .  ,  £  y.w.  =  0,  y.  =  0,j>i  +  l} 

1  l  *  1  ^  3  3  3 


,w* 


equals  Kr  .  If  y  c  H. 


(2.3) 


-1 


n+i  ■  -  nVi+i 


where 


Ki  -  J«j- 


If  x  e  K .  and  y  e  H . , 

•»  X  ^  X 


(x,y)  = 


n 

I  x.y.w. 
I  3  3  3 


=  y.  [Ix.w, 
1  l  3  3 


-  x. X1W. 1 
l+l  l 


i  0 

yy*  W* 

by  (2.2)  and  (2.3).  Since  Hr  is  clearly  ,  we  have  that  =  K 
Since 

^  ^  wlc  u*  W  + 

(  n  K . ) ~  =  K ~  +...  +  K~ 

^  i  l  n-l 

we  need  to  show  that 


Kj  +  ...+  K^_2  =  {y:  y^  >.  y2  2. 


..  2:  yn  =  0). 


H-l 


w* 

First  assume  x^  e  ,  i  =  l,...,n  -  1.  Then  we  may  write 

Xi  =  (xx,  -  x^w"1,  0,...,0)  (xx  >.  0) 

x 2  (X2 /  X2 ,  x2^2W3  9  0  #  •  •  •  *0)  ( x 2  »  0) 

x3  =  (x3,  x3,  x3>  -  x3W3w4',  0,...,0)  (x3  >.  0) 


rl. 


-n-l  -  (xn-l'  Vl  •••  xn-l'  '  xn-lVlwn  >•  (xn- 


After  adding  coordinates  we  see  that 


(T3t  -  (73+1 = xi  ^0' 1  = 1 . ”  - 1 


and 


(!*)  •  - 


Thus 


K~*  + 

XV  ^  • 


tJ* 

+  K~  ,  c 
n-1 


(y:  yx  >  y2  > 


^r" 


Conversely,  consider  y  =  (y,,...#y  )  such  that 

_  _  1  n  i 

r,  >  y,  >  ...  >  y  =0.  Recalling  that  W.  =  Z  w., 
12—  —  Jn  113 


we  partition  y  as  follows 
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I  X 

h-> 

II 

-  w2W-lv 

z  ^  /  0  /  •  • 

X2  =  ( 

.,-1 

-1 

-  w3W2  z2. 

-  w3W2  z 

X-  =  { 

.,-1 

-1 

-  w.W.  z-,. 

-  w.W_  z 

~3 

4  3  3 

4  3 

X  ,  =  (-ww\z  ,  >  Z  i) 

~n-l  n  n-1  n-1  n  n-1  n-1  n-1 


where 


: .  .  =  y .  +  W.  Ev.w., 

1‘1  1  1  wJ  ^ 


It  can  be  verified  that  the  i  column  of  the  above  array 

n 

sums  to  v.  and  that  each  row  is  such  that  Ex. .w.  =  0. 

1  13  3 

Finally  we  note  that 


y.  ,  >  y. 

Ji-1 

i-1  i 

W.  E  y.w.  W.  ,Ey.w. 
i  1  3  D  x"1i 3  3 


l  yjuj  ^  Mi-iyi  • 


Therefore 


i-1  n 

0  =  W7l[  E  y.w.  +  Ey.w.] 


iWTMw.^y.  ♦  WjWj  1 
-1  n 

=  +  W .  E  y  .w .  =  z  .  ,  , 

x  4  4.1  3  3  1-1' 
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elegant. 
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Corollary  2.3.  If  Kug  =  {  x:  0  <_  <  x^  £•••<.  xn>  , 

then 


KUS  =  {V  yi+l  -  yi  wj)  ^yjwj  ^  0  for  i  =  1/  •  •  •  *n  -  1}, 


Proof.  The  proof  follows  by  v/riting 


Kus  =  kia  n  {?:  X1  -  0} ' 


recognizing  that 


{x:  xx  >  0}~*  =  {y:  y^^  £  0, 
and  using  (1.1)  and  Theorem  2.1. 


y*,  =  = 


•  -  y„  - 01 


3.  THE  CONCAVE  ORDERING 


A  frequently  occurring  closed  convex  cone  is  Rn  is  the  class 

of  concave  (convex)  functions  KCC(RCV)  defined  on  the  set  of  real 

numbers  (x. ,***x  }.  Thus  a  point  y  =  (y, ,  •••y  )  e  Rn  is  inter- 
x  n  ~  x  n 

preted  as  the  function  whose  image  of  x^  is  y^.  If  we  let 
Ay.  =  y..,  -y.  and  Ax.  =  x .  ..  -  x .  ,  we  can  write 

•'i  Jri+1  Jx  1  1+1  1 

n-2 

Kcc  -  £  Hi 


where 


Ayi+1 

H  =  {  v:  — -  >  — } 

i  V-  cxi-  4X1+1 


(3.1) 


The  dual  cone  of  KCC(KCV)  is  surprisingly  tractable. 

Theorem  3.1.  The  dual  cone  of  the  set  of  concave  functions  on 

^Xi'***#xn^  *s  9*ven  fay 
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K 


w* 

cc 


n 


n-£-l 


z:  E  z.w.=0,  E  (x  »-x.)z.w. 
^  1  1  n-£  i  x  l 


=  0,1  =0 


>  0,£  -1,2, 


Proof.  The  proof  is  similar  to  Theorem  2.1  in  that  we 
w* 

first  find  hT  and  then  identify 

w*  w*  w* 


,n-2 
(3.2) 


H1  +H2+-‘-+Hn-2 


w  * 


We  first  show  PL  is  equal  to 


Mi=(z:  z_.=0,  j  /  i  ,i+l,  i+2,  ziwiAxi=zi+2wi+2Axi+l  -  °' 
i+2 

E  z  .w .  =  0  }  . 

j-i  3  J 


Note  that  z  e  implies 


Ax*+Ax .  (Axi2iWi)  +  Ax.  +'ax.j.,  (Axi+lZi+2Wi+2)+  Ax^+Ax^Zi+lWi+l 


Ax. 


Aiii  Axi+i 


i  i+1 
or  that 


z.w.Ax.  =  z. . -w. . ,Ax. . « 
xx  x  i+2  x+2  x+1 


x  ““i+1 


i  i+1 


“  ”zi+lwi+l  (ax.  +  Ax^+1) 


Thus  for  z  e  M .  and  h  e  H . , 
i  l 


n 

(z,  h)  =  E  z.h.w. 

-v  .  i  i  i 


=  ziwi4xi(KZ7)  +  zi+2wi+2Axi+l 


(  1  +  if1,  w 

W 

j 

h  i  \1 

\Axi  Axi+1'  i+1  i+1 

hi+l 

Ux. 

h  £x.  J 
x+1 ' 

IiWi1Xi  [iitj  +  4xi+1  '  hL+lUli  +  4xJ+1)] 

r^ii-^1  <o 

1  1  l  l.ixi+1  SX.  j  - 
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w’ 


by  the  definitions  of  H.  and  M. .  Since  clearly  M.  =  H. ,  we 

1  1  1  1 


w 

have  that 


w* 


If  we  let  z^  =  (z^, • • • #z^n)  G  *  it  is  possible 


to  show  that 


a)  (»V4xiV4xi+2)zi,iV(4xi«+4xi+2)zi.i+lwi.l+4xi+2zi,i+2wi+2*° 


and 


b) 


(Ax.  +  Ax. , . ) z. 

i  l+l  i, 


w.  +Ax.^.z.  .±.w,±.  =  0. 
l  l+l  i,i+l  l+l 


n 

These  facts  together  with  1  z .  .  w.  =0  and  z.  .  w.Ax.  >  0  enable 

j=l  x'3  3  1,1  i  i  - 

w*  J  w* 

us  to  verify  that  +•••+  H~_2  is  contained  in  the  cone  speci¬ 
fied  in  (3.2) .  Conversely,  any  vector  in  the  cone  in  (3.2)  can  be 

w* 

written  as  a  direct  sum  of  vectors  from  Hr  ,  i  *  l,***,n-2  which 
completes  the  proof. 

4.  APPLICATIONS 

Of  course  by  their  very  definitions,  a  convex  cone  K  and  its 

w* 

dual  K  give  rise  to  natural  inequalities.  In  particular,  if 
x  e  K  and  y  -  z  e  K  ,  then 


n 

E  x.  (vtz  .  )w.  ^  0.  (4.1) 

13  3  3  3 

This  has  some  straightforward  implications  in  terms  of  sample  co- 
variances  by  taking  w  =  1. 

Corollary  4.1.  Suppose  x,  y  and  z  are  vectors  in  Rn.  If 


1 

I 


> 


1  1+1 
+  11  J 


i 


1, 


,n  -  1,  and 


(4.2) 


1  x  i 

TElYi  ’  >  —  E  y.  -  z.,  i  *  l,...,n  -  1,  (4.3) 

i  1  3  3  i  +  1  1  3  3 


then  the  sample  covariance  of  (x,  y)  is  at  least  a?  large  as  the 
sample  covariance  of  (x,  z) . 


Proof.  Condition  (4.2)  states  that  x  e  KQA.  Condition  (4.3) 

implies  that  z  -  y  e  which  is  equivalent  to  saying 

1*  _  __ 

(z  -  y)  -  (z  -  y)  e  K~A  (where,  a  =  (a,  a,***,a)).  Thus 

n__n  _  n  _  n  _ 

E(x.  -  x)  (z.  -  z)  =  Z  x. (z.  -  z)  <  Z  x. (y.  -  y)  *  E  (x.  -  x) (y.  -  y)  . 

•  »  X  ^  1  i  1 

Of  course  if  z  =  0,  this  result  is  equivalent  to  saying  that 
if  x,  y  e  kda^Kia)  then 

(x,  y)  >.  n  xy  .  (4.4) 


Of  course  since  KDA  =  “KIA»  if  x  e  KJA  and  y  e  KDA  (or  vice 
versa) 


(x,  y)<_nxy. 

These  inequalities  are  as  strong  as  possible  in  the  sense  if 

X  t  Kda(KIA}'  one  can  find  a  X  e  kda^kia^  such  that  (4*4)  does 
not  hold.  Note  that  (4.4)  generalizes  the  well  known  result  for 

nondecreasing  (nonincreasing)  vectors. 

Another  application  concerns  Shaked' s  paper  (1979).  In  this 
paper  Shaked  wants  to  find  a  weighted  least  squares  projection  of 


say  g  onto  the  cone  KLg.  However  Shaked  actually  finds  the  projec¬ 
tion,  say  g*,  onto  the  cone  K^A  and  hopes  that  g*  is  in  KLg  (in  which 

case  2*  is  also  the  projection  onto  KLg) .  However,  if  g*  is  not 
n 

in  Kr . ,  i.e.,  Z  g*w.  <  0,  one  can  say  that  the  true  projection  g 
1  -1  3  n  A 

has  the  property  that  Z  g.w,  =  0  (see  page  89,  Barlow  et  al  (1972)). 

1  3  l 

In  this  case,  we  know  that  g  must  be  the  projection  onto  the  dual 
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A  «  ^ 

In  this  event  (see  (1.6)) ,  g  =  g  -  g  where  g  is  the  projection 
of  g  onto  which  is  a  problem  that  Shaked  also  solves.  From 
Shaked' s  solution  we  can  verify  that  g  -  g  =  g*  -  g.  Thus  the 
projection  onto  K  is  given  by 

Lih> 


A 


3  " 


n 

g* ,  if  Z  gt  w.  >.  0 
1  D  D 


n 

g*  -  g,  if  E  g*  w . 

!  3  3 


< 


0. 


A  useful  inequality  discussed  in  Kimball  (1951)  and  generalized 
in  various  places  such  as  Horn  ( i 9 7 9 )  and  Dykstra,  Hewett,  and 
Thompson  (1973)  concerns  the  expected  value  of  a  product  of  monotone 
functions  of  a  random  variable.  Thus,  for  example,  if  f,  g  are 
nondecreasing  (nonincreasing)  functions, 


Ef  (X)  •  g(X)  >  Ef  (X)  •  Eg  (X) 


assuming  the  expectations  are  defined.  We  can  develop  similar  types 
of  inequalities  based  upon  closed  convex  cones  and  their  duals. 

Corollary  4.2.  If  f,  g  are  real  valued  functions  in  the  class 

A^  =  {f:  f  (X )  is  integrable,  E  [f (X) I j ] /P (X  <.  x) 

is  nondecreasing  over  (x:  P(X  <.  x)  >  0 } }  , 

then 


Ef  (X)g(X)  >  Ef  (X)  •  Eg (X)  . 

Proof.  Suppose  first  that  X  is  finitely  discrete  on  the  set 
{x^, . . . ,xn) .  If  we  let  w  *  (w^, . . . ,wn)  where  w^  =  P(X  =  x^) »  then 
the  condition  that  f  c  is  equivalent  to  saying 

(f (xx) ,  f (X2)  » . . . »  £ (xn)  g  K 
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If  g  e  A^,  Eg(X)  -g  must  belong  to  KJA  and  the  result  follows. 

In  the. general  case#  we  let  x  .,  j  =  0,...,k(n)  be  a  series 

“  /  J 

of  nested  partitions  covering  the  support  of  X  which  generate  the 
Borel  sets  in  the  support  of  X.  We  define 


We  have  from  the  first  part  of  the  proof  that 

E  f(X)  Eg (X)  =  Ef n (X)  Egn(X)  <.  Efn(X)gn(X)  for  all  n. 

Therefore  if  f  is  bounded  above,  by  Fatou's  lemma, 

Ef  (X)Eg(X)  <.lim  supEfn(X)  •  gn<X)  <  E  lim sup  fn(X)gn(X)  =  Ef(X)g(X). 

(4.5) 


Finally,  noting  that  if  h  e  A  ,  so  does  min(h,  c)  for  any 
positive  constant  c,  we  have  the  desired  result  for  min{f,  m) 
and  min{g,  m} .  Note  that  (4.5)  guarantees  that  E[f(X)g(X)  ]  <  *. 

If  E[f(X)g(X)+]  =°°,  the  desired  result  clearly  holds,  so  we  may  assume 
that  f(X)g(X)  is  integrable.  Finally,  letting  m -*.  »  and  using  the 
Dominated  Convergence  Theorem  on  each  side  concludes  the  proof . 

We  can  obtain  similar  type  inequalities  by  working  with  other 
cones  and  their  duals.  For  example,  we  can  establish  the  following 
corollary  which  is  closely  related  to  the  basic  lemma  of  Marshall 
and  Proschan  (1970) . 

Corollary  4.3.  If  f  is  a  real- valued  nondecreasing  function  with 
f (X)  integrable  and  g  is  a  real-valued  function  in  the  class 

Bx  =  (g:  g(X)  is  integrable,  E ( x) ^x<x^  ~  E<?(x)  for  all  x} , 
then 


Ef  (X)g(X)  >.  Ef  (X)g(X)  . 

Proof.  The  proof  follows  the  lines  of  Corollary  4.2  and  is  not 
given . 

Note  that  if  we  define  the  class  of  real-valued  functions 

Cx  =  (g;  g(X)  is  integrable  and  g  is  nondecreasing}, 

then  CxcaxcBx<  Thus  both  Corollary  4.2  and  Corollary  4.3  generalize 
Kimball's  inequality.  The  results  of  this  section  enable  us  to 
obtain  some  insight  into  certain  types  of  positive  dependence  as 
discussed  in  Lehmann  (1966)  and  elsewhere. 
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Let  us  say  that  the  random  variables  (X,Y)  satisfy  the 
following  kinds  of  positive  dependence: 

1)  Type  I  if  P(X  <.  x,  Y  £  y)  >.  P(X  £  x)P(Y  £  y)  for  all  x,  y, 

2)  Type  II  if  P(Y  >.  y|x  £  x)  is  nondecreasing  in  x  for  all  y, 
and 

3)  Type  III  if  P  (Y  >.  y  |X  =  x)  is  nondecreasing  in  x  for  all  y. 
Assuming  that  all  quantities  are  defined ,  each  of  the  above  types  of 
dependence  can  be  characterized  by  the  inequality 

Ef (X)  •  g (Y)  >  Ef (X)  •  Eg (Y)  (4.6) 

as  shown  in  the  following  Theorem. 

Theorem  4.1.  Assume  g  e  Cy.  Then  (X,  Y)  exhibits  Type  I,  II ,  or 
III  dependence  iff  (4.6)  holds  for  all  f  e  Cx»  Ax»  or  Bx  respectively. 

Proof.  The  result  for  Type  I  dependence  is  handled  in  Lehmann  (1966) . 
For  Type  II,  let 

h(t)  =  P (Y  >  y|x  »  t)  . 

Then  h  e  Ax  iff 

E{P(Y  2.  y|X)I  (JtLx)]/P(X  <  x) 

-  p(y  >  y[x  £  x) 

is  nondecreasing  in  x.  Thus  if  f  also  belongs  to  Av,  we  have  by 

A 

Corollary  4.  2 

E[f(X)h(X)J  =  Ef(X)  •  I  (4.7) 

i  Ef  (X)  •  P (Y  z.  y) ,  for  all  y. 


Thus 
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Ef  (X)  Ea.I(yiy  }  >  Ef(X)  Ea.P(Y  >  y ±) 

for  all  nonnegative  a^.  A  passage  to  the  limit  will  imply  the 
desired  result  for  a  nondecreasing  g  in  Cy.  If  P(Y  1  y|x  >  x)  is 
not  nondecreasing  in  xr  then  h  {  A^  which  implies  there  is  an 
f  e  A^  such  that  (4.7)  does  not  hold. 

The  case  of  Type  III  dependence  is  handled  similarly. 

We  note  that  while  Type  I  dependence  is  symmetric  in  X  and  Y, 
Types  II  and  III  are  not  as  is  evident  from  our  characterizations. 
In  some  sense,  the  size  of  the  sets  C^,  A^»  and  is  a  measure  of 
the  relative  strengths  of  the  dependence  relations. 

We  can  ut!e  the  dual  cones  deriven  in  section  3  to  obtain  in¬ 
equalities  for  concave (convex)  functions  somewhat  similar  to  those 
given  in  Corollary  4.2.  To  set  some  notation,  we  note  that  if  the 
random  variables  X  and  f (X)  are  square  integrable,  then  the  linear 
function  of  X  which  is  closest  to  f(X)  in  the  sense  of  minimizing 
E(f (X) - (aX+b) ) 2  is  given  by  £f(X)  =  afX  +  bf 


where 


and 


af  = 


E (Xf (X) )  -  E (X) Ef (X) 


(4.8) 


bf  =  Ef  (x)  -  afE(X) 


as  shown,  for  example,  in  Brunk  (1965) .  It  is  well  known  that 
Ef(X)  =  E  £j(X)  and  EXf(X)  =  EX  £f(X).  Interestingly,  if  f  and  g 
are  both  concave  (convex)  functions  such  that  f(X)  and  g(X)  are 
integrable,  then  replacing  f (X)  and/or  g(X)  by  their  linear 
approximations  can  only  decrease  the  expected  value  of  the  product. 
We  begin  with  a  more  general  result  for  discrete  random  variables. 


Corollary  4.4.  If  the  random  variable  X  is  finitely  discrete 

(on  the  values  x  .  <  x„  <•••<  x  ),  f  is  concave  on  the  range 
i  n 

of  X  and  g  is  such  that 

1)  Eg (X)  =  0, 

2)  EXg(X)  =  0, 

3)  E(x  -  X)  g  (X)  I  ^  <  x)—  0  for  x  the  support  of  X, 

then 

Ef (X) g (X)  <  0. 

Proof.  The  proof  follows  directly  from  Theorem  3.1  by  letting 
w.  =  P(X  =  x. ) 

l  l 

An  important  class  of  functions  which  satisfies  the  above 
conditions  is  given  in  the  following  theorem. 

Theorem  4.2.  If  g(x)  is  convex  then  g(x)  -  (a  x  +  b  )  (as  de- 
-  g  g 

fined  in  4.8)  satisfies  conditions  1),  2)  and  3)  of  Corollary  4.4. 

Proof .  The  proof  is  trivial  if  g  is  linear  so  assume  that  it 

is  not.  It  is  easily  shown  that  conditions  1)  and  2)  hold  so  we 

consider  condition  3) .  Now  by  the  convexity  assumption, 

g(x)  -  (a  x  +  b  )  must  be  positive,  negative  and  positive  again. 

7  9 

1 

Thus  I  g(x.)  -(a  x.+bj  must  first  be  nonnegative  and  then  non- 
j=i  J  g  j  g 

positive  as  i  increases  from  1  to  n.  Thus  g(x)  -  (a  x  +b  )  is  in 
w*  9  9 

the  cone  K^.  (see  1.3)  for  the  weights  w^  =  P(X  =  x^)  .  Since  for 

each  i,h(x.)  =  sup{x.  -x.  0}  is  in  -K_  (see  1.2),  condition  3) 

3  1  3  * 

must  hold  by  the  definition  of  dual  convex  cones. 

This  leads  to  the  following  corollary  which  also  holds  for 
the  continuous  case.  Note  that  b)  is  similar  to  Kimball's  Inequality 
with  monotonicity  replaced  by  concavity  (convexity) . 

Corollary  4.5.  If  f  and  g  are  both  concave  (convex)  functions 
such  that  X,f(X)  and  g(X)  are  all  square  integrable,  then 
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a)  £f (X) g (X)  >  Ef (X) (a  X+b_)  =  E(a,X+b,)(a  X+b  )  . 

-  9  9 

Moreover,  if  EXf(X)  -  EXEf(X)  and  EXg(X)  -  EXEg(X)  have  the  same 
sign,  then 

b)  Ef (X)g(X)  >  Ef (X)  Eg (X) . 


Proof .  The  first  inequality  follows  by  considering  finer  and 
finer  partitions  of  the  support  of  X,  noting  that  f  and  g  are 
concave  on  the  partition  points,  and  employing  Theorem  4.2  and 
Corollary  4.4  together  with  limiting  arguments.  The  equality 
in  a)  follows  from  agx  +  bg  being  both  concave  and  convex. 
Inequality  b)  then  follows  from  Kimball's  Inequality  on  the 
last  part  of  a)  . 
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